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(54) AUTOMATIC MEASURING AND VISUALIZING SYSTEM 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a 
system which instructs a user about which 
dimension is to be measured through a graphic 
interface so as to automate the maintenance 
process, which automates the acqusition and the 
storage of its measured value, and by which the 
measured value is compared with corresponding 
engineering specifications and history data. 
SOLUTION: The graphic display of a machine 
structure to be measured is stored in advance in a 
video storage device 23. A user 5 selects the 
dimension of a machine, to be measured, through 
a manual input device 1 1 . A preferable viewpoint 
is decided by an image creation device so as to be 
sent to the video storage device. A guidance 
video overlay device 19 receives an instruction 
regarding a dimension, to be measured, from the 
manual input device, it provides the graphic 
overlay of a preferable tool to be used, and it 
displays the installation position and the usage method of the tool on a machine image 
from the image creation device. 
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1. TitteoJ Invention 

Automated Measuremonts Arut v/isualizaticin System 

2. CJaims 

1. An automatfo visualization and measurement s/ste<n for obtaining 
measurements of desired dimensions of a mach^e structure 
comprising: 

a) a video storage device having a pre-stored grapliical 
representation of said structure, capable of providing grapfifcal 
r^resentation of said striicture such that an image of said 
structure viewed from a epecrfic \flewpoint may be created; 

b) a manual input device, for providing user-supplied information 
defining dinnensions to be measured, and tests to be perfomned to 
the system; 

c) in^ge creation device coupled to the video storage devfoe and 
manual input device for operating to receive user input and d^ne 
a viewpoint for the dimension being measured and esrtract a 
graphic representation from a video storage device substantially 
oorrespcnding lo this viewpoini; 

d) a video instruction overlay coupled to manual input device 
operating to provide graphic overlays of the preferred too) for each 
dimension measurement, and the preferred positioning of and use 
of the tool; 

e} a video merge device coupled to the image creation device and 
inslructionaJ video overlay device, for combining grapl^ical 
representations of said machine with overlays from instructional 
overlay device; 

f) a display device coupled to video merge device, for displaying the 

combined video to a user; 

g) a measurement tool havaig a tool interface, capable of providing 
automated readings; 

h) a measurement storage capable Of Storing measurements provided 
to It; 

i) a control device coui^ed to measaremenl tool to measure storage 

for storing measurements from measurement tool in measurement 
storage operating to compare and analyze measurements against 
each other or against other stored measurements, and operating 
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(9) 000- 1 36906 

to provide a graphical display of snafysis to video merge device 
causing the graphical display to be viewed on display device. 

2. The automatic visualization and measurement system of claim 1 
further comprising: 

video archive coupled to imsge creation device having pra-stored 
hietoncai video data, ailowing video archive device to coitipare 
video data over different time periods to provide lime lapse" 
movies, and analyze trends. 

3. TH$ automatic visualization and measurement system of claufn 1 
further comprising 

a) audio instruction device coupled to the instructional video overlay, 
for piwiding audio frislmctlon signaf synchronized with 
Instructionaf video from instructtona! video overfay device; and 

b) an audio driver coupled to audio instruction device, for creating 
audible sounds from the audio instojction signal. 

4. The automatic vieualization and measurement system of claim 1 
further comprising: 

a measurenjent archive device coupled to control device having 
pre-3tored historical measurement data, allowing control device to 
compare meaaurement data over different time periods to analyze 
trends. 

5. The automatic visuaEzd&sn and measurement system of claim 1 
fur^er comprising; 

an annotation storage device coupled to contrc^ device having pre- 
stored hbforical annotation. allovsA'ng control device to store 
current annotations, and retrieve and display historic annot^na. 

6. The automatic vlsualizatian and m^surement system of daim 1 
wherein; 

a) ihs video storage device has a pro-stored 30 computer graphJc 
model; and 
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b) the image creation device is a 3D graphic rendering device which 
provides a 20 image of the 3D model as viewed from (he prouicfed 
viewpoint. 

7. The automatic vi$yali2ation and measureflnent system of claim i 
ivhereln: 

a) the video storage device has a pluraifty of pre-$tored 2D images 
each acquired at a different viewpoint, and each corresponding to 
a different dimension measurement; and 

b) the image creation device Is a image creation device 15 which 
selecis a 2D image from the plurality of 20 pre-etored images 
which most dosely matches the provided viewpoint. 

8. A method for instnicting a user and obtaining automated input of a 
machine from a measurement device comprising steps of: 

a) determining a dimension to t>e measured from user-supplied input: 

b) looldng up a graphical representation of the machine to be 
measured corresponding to dinoension to be measured: 

c) creating a video overlay Indicating the proper tool to be used for 
measuring the specified dimension; 

d) providing the graphical rsfmsentation of the proper tool in proper 
position to measure (he specified measurement; and 

e) automatically acquiring measurements from a user-guided tool, 
having an Interface, when ^e interface is activated. 

9. The method of claim $ further compristng the steps, of: 

providing audo explanation of the proper tool to use and operation 
of the tool for different measurements. 
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3. Detailed Description of Invenlion 
BACKGROUND Of THE fNVENTION 

1. Field of the Invention 

The present nr/ention related to measurement and design of 
unique ref^cement parts for large industrtel machine structures. 

2. Discussion of Prior Art 

It is often necessary to manufacture replacement parts for large, 
liigh precision industri^ machines such as steann turbines, generators, 
locomotives, large ships, olt refineries, Iron mills, stamping mills, 
factoiy tools and other types of large scale macf^inety which Is either 
impossible or impracScal to bring into a shop for in-housa 
measurements. Typically, a large casing stmcture is to be reused and 
the internal stationary and rotating parts are to be replaced. In order to 
manufacture these replacement parts, it is necessaiy to measure a 
large number of interior dimensions of the casing. 

Several problems exist in maidng high accuracy measurements 
on site: 

1) the maintenance person do not know vtrhieh is the proper toof to 

use; 

2) the maintenance person does not know the exact location of 
dimensions, and/or clearances to measurement; 
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3} the maintenance person does not Know how to properly position 
the too; 

4) the maintenance per$on inaccurately reads the measurement 
numtjer; and 

5) the maintenance person makes errors In transcribing the 
measurements during input to a data base or computer system. 

The measurement activities often occur during a shut down, or 
maintenance period, during which the turbine is out of service and 
disassembled. The owner of the machinery wishes to minimize the 
length of the shutdown period, since no revenue Is produced durmg 
the outage. Thus, for a utility, access is allowed for a peiiod of Z-4 
days on average. Also, during this access period, personnel 
measuring the case must share access with many other woifcers. The 
restricted time Mrindow' places severe restri^ons on the amount of 
data that can be {jathered during the visit. 

Much time also goes into preparing a detailed plan of exactly 
what to measure during the on-site visit. The pre>planning is difficult, 
since often the interior design of the unit is not known in advance. 

Ser. No. 08/888,795 filed 7/7/97 Allowed. RD-25543 "A Portable 
Measurement System Using Image and Point Measurement Devices * 
by Nelson Corby, Christcpher Nafis. Boris Yamrom described how to 
obtain precise measurenrtents of Industrial structures, but did not guide 
the user as to what are the critical clearances to measure, precisely 
where they were, and how to measure tliem. 

(n the course of disass^bling, setvicing a-id reass^bling 
large machines, it is necessary to measure and record many 
dimensions \MMn the machines. An important type of measurement 
ore clearance measurements - i.e. the gaps between rotating and 
stationary parts. There are hundreds of such clearances to measure 
and the measuremer^ locations are located all over the machine 
structure at speciTc critical places (defined by design engineers). 
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Engineering will also define specific procedures for making these 
measurements. 

In many cases, the parts being replaced represent a nev«r or 
ainended design for tha service company. Thus, it is currenti/ 
necessary for a skilled design engineer to accompany the group to the 
site artd to guide the measurement process. Given the small number 
of such eng^eers. it can be dilTicult to locate and send such a peison 
on short notice. 

A further complication Is ^at usuaNy the part designers are not 
the same people who visited the site and performed the 
measurements. It would also be desirable to provide the design staff 
witfi a method to nneasure needed dimensions during a later time off* 
site. 

The measurement person is usual^ not an engineer and wifl 
require guidance and help from an onsite supervisor to guide him in 
locating the measurement locations and in specifying the method of 
measuring a given clearance. It is often difficult for the supervisor to 
provide this information from poor quality or conftising paper 
blueprints. 

The usual practice is to employ two man teams - one to make 
measurements and second to record Hie data on paper sheets 
provided by the utility owner or equipment mani^cturer. There can be 
errors in communicating and recording the measurements caused by 
long working hours, the high noise environment of the power plant 
and poor penmanship. 

Different tools are required to measure different measur^ents 
with a high degree of accuracy. Sometimes these tools mey be highly 
accurate for a small measurement, however the accuracy is lost with a 
larger measurement is made. 

Standard measurement tools consist of taper gages, 
micrometers, calipers, scales, sAding parallel blocks and various 
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plated or sheets of metal. It i« often necessary to us© auxIKary 
apparatus such as machinist's squares, gage btoCH&, ground fiat 
tooling pl«ie» eta to 'extend" the range of the measursment tools at 
hand. This is usually left up to the creativity of the measurement 
per$on< Lately, new toots with electr<^ic encoders (to naad the 
measured value) vMt oonnection to taptop computers or electronic 
data logging system have been used to increase the speed and 
accuracy of reading the tool and storing the maasurement. 

After all the clearancse measurements are made, the supervisor 
will compare the actual measurements with the expected 
measurements. These axpedsd values typically oome f^om 
manufacturers specification sheets or from historical records of the 
specie machine being sen/iced. He will compute deviations and enter 
them on the sheets. The resultant set of papers contains the current 
set of dimensional data for the machine and the deviations from 'Weal" 
or expected. The supervisor then has to form an opinion as to the 
"correctness" or state of the machine. If the data indicates ooirac^ 
dimensions, then the final assembly (or dis-assembly) can proceed. It 
is often difficult for the supervisor to ascertain correct aiignmenta and 
odantations from the tabuisr data. 

Aft«r thd service period, the unit is re-assembled-and returned 
to service until the next scheduled shutdown, typically 2-3 years later. 

After th9 on-site visit has concluded, the turbine or generator 
servlce company must prepare Initial part designs, a price quotation 
and fif successful in bidding) then prepare detailed manufacturing 
drawings to guide the manufacture of the replacement parts over the 
next 12-24 months. At the next opportunity usually 1S-24 months later 
during the next turtsine overhaul, the service company returns and 
installs the new repiaoement parts, If the parts are inocrrect at 
delivery, then costly on-site machining may be necessary to correct the 
design. Re-machining on-site may become also very difficult, time 
consuming and expensive. If re-machining delays the return of the 
turbine to service, then the service company may incur cost penalties, 
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Thus, it would be desirable to develop a system that would 
Instruct 9 user wNch dimensions to measure tiirougii a graphical 
interface, automate the acquisKion and storage of these 
measurements, and compare these to corresponding engineering 
specifications and historical data to automate the maintenance 
process. 

Currently, there is the need for a system which accurately 
instructs a user on what type of tool to use, how to operate the tool, 
the prea'ee location to apply the tool to make measurements of 
dimensions and automatically to store the measurements taken. 

SUIMIVtARY OF THE INVENTION 

An automated visualization and measurement system obtains 
measurements of dimensions of a machine structure. 

A video storage device has pre-stored graphical representation 
of said structure. These may be a series of 20 Images or a 3D 
compute model. A user selects dimensions to be nieasured dnd tests 
to be perfonned through a manu^ input device. 

ima^e creation device receives the user input from nnanual input 
device and detennines viewpoints corresponding to the current 
meascrenrwnt to be performed. It then interacts with the video storage 
device to extract a graphic representation and create an image 
conrespondtng to tiie viewpoint. 

A video Instruction overlay device also receives information from 
ttie manual input device and provide graphic overlays of the preferred 
tool for eat^ dimension measurement It also pto^Ades illustrations, 
and/or video dips of the preferred positioning and use of th9 tool. 

A video merge device merges images from the image creation 
device and overlays from the instructional video overlay device into a 
video signal provided to a display device for displaying the combined 
video to a user. 
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An suiorratic measurement tool capable of providing automated 
readings, is ooupfed to the system. It is activated by a tool interface. 
Wtien th& user activates tiie tool interface, a measurement reading is 
electronicaiiy sent to a control device. 

The control device stores the reading on the measurement 
storage. Control device therefore reduces human transcription error. 
Control device afso can compare and analyze measufsments against 
other stored nieasurements to detemnine trends and changes over 
time. 

Control device may also provide a graphical display of ite 
analysis to video merge device causing the graphical display to be 
vieuwd on display device. 

In an alternative embodiment, historic video archives may be 
compared to current video by image creation device. 

Also, annotation stored in annotation storage, being either text, 
voice, sound recordings, still pictures, or video dips may be stored and 
played back to a user at a later lime. 
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DETAILED DESCRIPTION OF THE INVENTION 

While the novel features of the invention are set forth with 
particularly in the appended cTaime, the fnventioa both as to 
organization and content v/ill be better understood and appreciated, 
along wfth other objects and features thereof, froin the folloiwing 
detailed description taken In conjunction with the drawings, 

The present nivention performs several funcb'ans required for 
maintenance of large high precision machinery. On© of the first 
functions is to show through a visual interface the actual Jocatfon of 
currents or dBiiensions to be measured. 

The present invention also suggests tools to be used for each of 
the specific dimensions measurements and also provides a graphical 
representation of the tool such that the user may readily Identity the 
tool 

Another function of the present invention is to provide in 
animation or other graphic representat'on, of plaoemerrt of the tool, 
and how the tool is to be operated. 

Another function of the present invention is to automatically 
read the measurement provided by the tool directiy into a cenirai 
processing unit for storage In comparison to previous measurements. 

Figure 1 shows how an embodiment of the present invention 
incorporating a laptop 3 computer may be attached to large high 
precision machine 1, or machine structure, such as turbine shown in 
Figure 1 . Since machine 1 is not easJIy moved to a laboratory or a 
main measurement facility, the engineer, or user, simply visits the site 
and attaches the lap top computer and tool 6 to machinery 1 . 

In Figure 2. a user 5, which is typically the field engineer at the 
site, interacts through a manual input device 1 1 to identify what types 
of measurements are to be performed. The position of the user may 
also be determined by optional tracking device 13, which traci<s the 
location of user 5 and provides that location to a ims^e citation device 
15. 

Manual input, such as the viewpoint, is also provided to image 
creation device 1 5. Other Intbrmation, such as measurements and 
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tests to be performed are input to a control device 17 from manual 
input device 11. 

Control device 17 determines predefined steps of the 
maintenance process which are Indicated to a instructional video 
overlay device IS and an optional audio instruction device 21. In one 
embod^ent a video storage device 23 has a plurality of pre«tored two- 
dimensional images of the actual machine 1 to be maintained, or of a 
similar machine, from a pfuraltty of predefined viewpoints. These 
viewpoints are typically within a range in which a user would be 
positioned to make the measurements of a given dinrtension. Each 
one is keyed to a location of user 5 and also is tied in witfr dimensions 
to be measured. 

in another embodiment, video storage device 23 has a 30 
CAD/CAM nrK3dei, or similar three dimensional model, of machine 1 
such that given a viewpoint, a con^spondlng view of the model may t^e 
displayed. 

Hierefore, v^en Image creation device 15 b provided with 
either the dimensions to be measured and/or the viewpoint of user 5, 
appropriate visual images may be provided from video storage device 
23 tc image creation device 15. These 20 or 3D model images are 
provided to a video merged device 27 which merges ti^s video whic^ 
comes from instructional video overlay device 1 9. Instructional video 
overlay device 19 has a plurality of animations and/or graphics, such 
as arrows and markers, which highlight dimensions to be measured on 
the Image. These animations and graphics are provided from video 
storage device 23. The animations and/or overlays may be 
synchronized with audto instructions provided by audio instruction 
device 21 is played through an audio driver 29. 

For each step of a predetermined maintenance process, the 
system provides either, a two dimensional drawing or image with 
measurement areas highl^hced by overlays. 
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In its more compiex form, a video animstior) may be 
s/nchronized wJth audio Instructfons walking user 5 through a desired 
maintenance process. 

Instruotiona! video overlay device 19 may play back short cflps 
of a proper tool in its proper position measuring a givei) dimension. 

Video merge device 27 provides its output to a dtepiay device 
31 which displays video to user 5. Display device 31 may a 
standard cathode ray tube disptay monitor, or nrxire preferably, a 
compact portable display, such as an LCD dispiay. The user 5 then 
selects the proper tool 33 and positions it as shown on display device 
31 and activates a tool mterface 35 to cause the tool to send a 
measurement to control device 17. Control device 17 interacts with 
measurement storage device 37 to store the actual measurements 
directly (hereby eliminating human error In transcription of numbers. 

In another alternative embodiment, a measurement archive 
device 39 has previously stored measurements for each of the 
dimensions from past maintenance sessions. Control device 17 may 
compare measurements from both measurement archive 39 and 
current measurement storage device 37 and provtde the results to 
video m^ge devioe 27. Grap hical representations of deviations is 
displayed on display device 31 . 

Measurement archwe 39 may also have the onginal 

specification measurements for a new machine 1. Each set of 
ineasuremenis is identified by a date when it was acquired. These 
may also be comparad to Vne actual measurements storcKi in 
measurement storage devioe 37 or previous measurements in 
measurement archive device 39 or a combination of ail cf them to 
show the growing trends over time. Not only are the actual differenoes 
fi^m the specification easy to determine, but the rate of change of 
each of the measurements. This may be used In indicating and 
projecting it in the future to determine ^lure of a given part. 
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AR memory and data storage devices, such as video storage 23. 
video archive 25. measurement archive 39, measurement storage 37, 
annotation storage 37, and stored portions of instructional video 
overlay t9 may be separate elements, or alternatively, separate 
portions Of a larger common data storage device. 

In still another emt^odiment, an annotation storage device 4t is 
coupled to control device 17. Text notes may be entered by manual 
input device to control device 17 and stored in annotation storage 
device 41 . These may be a warning that a certain cracit may be a 
problem, or watched in the next maintenance visit, it rnay also put in 
notes specitic to this structure being measured as infbrmatton to ttte 
next service person who may visit the site. 

The annotations may also be sound recordings, both verbal, 
and recording of the sound of the machine stmcture as it is 
functioning, or malfunctioning, still photos, video cfipe, or a 
combination of elt of the above. 

In Figure 3, a contact type measurement probe is shown. Thts 
would be used in pJace of measurement tool 33 of Figure Z A gap 
between surfiaces 7 and 9 is to be measured. A contact type 
measurement proba 40 is inserted between surfaces 7 and 9 and is 
extended into this gap by a long handled wand 41 . Operator buttons 
35 opeiats as the taie interface and run a motor/encoder 43 which 
turns a threaded rod 46. Threaded rod 45 causes feelers 47 and 49 to 
extend outward and upon touching surfaces 7 and & indicate the gap 
between these surfaces. The encoder is pre-calibrated to detemiine 
the number of revolutions and the pitch of the threaded rod 45 to 
determine the actual distance witii accuracy between feelers 47 and 
49. 

In Figure 4, a non-contact type measurement probe 50 is shown 
having a long handled wand 41 and operator buttons 35 as (n Figure 3. 
This operates with a laser diode 55 which reflects off surface 7 and is 
passed through lens 53 to a photodetector 51 . Then typical laser 
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ranging technique$ are used to determine the distance between 
surfaces 7 and 9. 

The proposed tnventton seeks to solve the problems noted 
above. It is an integrated, compact, portable, computer-based eystem 
that guides the msasurement person in identi^ing the specific place 
and messurement method (thru display of pictures, dragr^ms, 
drawings and onscreen text on a graphical screen), elecironically 
reads the measurement tool and electronicafly transfefs and stores 
the readings and which provides numerical and/or graphical 
comparisons between current readings, ideal readings and historical 
readings. In addition, the system provided the capabiGty to acquire 
and store auxiliary infomiatton {such as digital im$^e$ of selected 
portions cf the machine being serviced or textual inspection repcH'ts) 
with the measurement data of the current visit 

The system is operable by a single person (saving money), 
allows the measu/er to proceed with less guidance from a supervisor, 
guarantees higher accuracy (by er^suring that the proper point is 
measured using the proper procedure), and through graphical display, 
provides more complete visualization of measured data and 
comparison with reference data. Measurement ^'probes* of various 
types can be attached and used to rapidly and accurately measure 
specified features. 

The probes can taloe many forms. Cixrent devices include 
elactronicafly readable micrometers and vernier calipers and 
insb'uments "taper gages" as described on pages 123-138 of the 
"Starrett Catalog", No. 29, April 199S, published by the StarrettCo.. 
121 Crescent Street. Athol, MA 01331, (508)249-3551. Amore 
flexible device vtrould be a Vand-type" probe perhaps 1/4 inch in 
diameter and 2-3 fieel long with a tip portion that uses either contacting 
(mecharu'cal) or non-contacting (optical) methods to measure 
dimensional features. The drawings indicate a number of embodiments 
of both. The key feature would be to provide a probe that can 
measure a wide range of gap widtiis (say 0.25 to 8 inches) and which 
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could b« placed conveniently by the meadurer without having to wedge 
his bcdy and arms in the narrow {Q-8 Inch) and deep (2-3 Teet) gap 
between turbine wheels or d^cuft to reach places of generators. 

Whire apec^ embodiments of the invention have been 
illustxated and described herein, it is realized that modifications and 
changes will occur to tho^e akiiled in the art It ia, therefore, to be 
understood that the appended daims are intended to cover all such 
modificatione and changes aa fall witfiin the true spltit and scc^ of the 
invention. 

4. Brief Deecription of Drawiigs 

Figure 1 is one embodiment of the present invention aa it is being 

operated on a large turbine; 
Figure 2 is a simplified block diagram of another embodiment of the 

present invention: 
Figure 3 shows one embodimeflt of a contact-type measurement 

probe; and 

r^ure 4 shows an example of a non-contact type measurement 
probe. 

FIG. 1 



1 
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FIG. 2 
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FIG. 3 
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1 . Abstract 

Graphical representations of a machine $tructure desJred tc be 
measured are pra-stored in a video storage device. A user selects 
dimensions of tfie machine to be measured through a manual Input 
device, The preferred viawpoints for this measurement are determined 
by a image creation device. These viewpoints are provided to video 
storage device to create an Image of the machine structure showir^ 
tfie dimension to be measured. An instruciiorwl video overlay device 
receives an indication from Oie manual input device of the dimension to 
be measured. It then provides a graphical overlay of a preferred tool to 
be used and shows its pretend positioning and use on the machine 
image from image creation device. These are merged by a video 
merge device and displayed to a user on a display device. The users 
then selects the tool, positions, and uses it as instructed. When 
activated by Itie user, the tool directly provides measurement 
informatfon to a oontnji device which stores the information, reducing 
human error. In an altemath/e embodiment aucflo instruction may be 
added and synchronized ui#t the video instruction. 

2. Representative Drawing: Figure 2 
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